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A PROOF OF THE ERGODIC THEOREM USING 
NONSTANDARD ANALYSIS 

TRISTRAM DE PIRO 


Abstract. The following paper follows on from [2; and gives a 
rigorous proof of the Ergodic Theorem, using nonstandard analysis. 


1. The Ergodic Theorem 

There are many versions of the ergodic theorem, but the one we will 
prove in this paper, using nonstandard analysis, is the following; 


Theorem 1.1. Ergodic Theorem 

Let (12, £, p) be a probability space, and let T be a measure preserving 
transformation, then, if g E L 1 (12, £, p); 

og(uj) = Zim, woo i o 9(T 1 uj) 

exists for almost all uj E 12, with respect to p, and, og E U 1 (12, £, p), 
with; 

J n ogdp = J n gdp 


Remarks 1.2. There are a number of good standard proofs of this re¬ 
sult. A particular good reference is [3] . However, the reader should be 
aware that it is assumed there that £ is complete and T isinvertible, 
in the sense that T is one-one and onto, and both T and T _1 are mea¬ 
surable. A m.p.t is then required to satisfy p(C) = p{T~ l C) for all 
Ce t We will not require these assumption in the proofs of this sec¬ 
tion, in the sense that we only require a m.p.t to be a measurable T 
with p(C) = p{T~ l C) for all C E £. In [3], a seemingly stonger result 
is shown, (under the above assumptions), namely that if C E (£, with 
T~\C) = C, then; 
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Sc °9 d T = Sc 9 d l l (*) 
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from which it easily follows that if €' is the sub a-algebra of all T- 
invariant sets, where a set C is T invariant in ifT l C = C a.e dp, 
then og = E(g\(£), (**). In the particular case when T is ergodic, that 
is every T invariant set has measure 0 or 1, we obtain the well known 
result that og = E(g) a.e dp, (***). However, this result (*) follows 
easily from our Theorem M.il as we can, wlog, assume that p(C) > 0, 
and then restrict and rescale the measure. Of course, we even obtain a 
slight strengthening of (*), by our weaker assumption on a m.p.t, and 
obtain similar strengthenings of (**) and (***). (It is not necessary 
to restrict attention to real valued functions, in the statement of the 
theorem, the complex version follows immediately from the real case). 

As usual, we work in an N i -saturated model. Let k G *A/>o be in¬ 
finite, and let K = {x G *A f : 0 < x < k}. We let & be the algebra 
of all internal subsets of K. Observe that as K is hyperfinite, A is a 
hyperfinite *a-algebra. We let v denote the counting measure, defined 
by setting u(A) = Car T A ) ^ f or A E &. We adopt some of the notation 
of Section 3 in [4], and let P = °u. By Theorem 3.4, and remarks 
before Lemma 3.15 of [4], P extends uniquely to the completion 23 of 
the a-algebra, a(.fi), generated by JL It is clear that (K,*B,P) is a 
probability space, it is also the Loeb space associated to v). We 

let (j) : K —> K denote the map defined by; 

4>(x) — x + 1, if 0 < x < k — 1 

<f>(x) — 0, if x — k — 1 

Clearly, <f is invertible, internal, preserves the counting measure u, 
and 0 _1 (a(^)) = cr(&). Then Pcnf ^ 1 defines a measure on (K, a(^), P ), 
extending v. By Theorem 3.4(ii) of [4], it agrees with P. By definition 
of the completion, P o <f>~ 1 agrees with P on ( K , QS, P), so <f>, and sim¬ 
ilarly 0 _1 are m.p.t’s. We will first prove the following; 

Theorem 1.3. The ergodic theorem, as stated in Theorem \1.11 holds 
for (K, *3,P,(j)). 

Proof. Let g G L l (K, 23, P), without loss of generality, we can assume 
that g > 0. For x G K, we let; 


g(x) = limsupn 
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g(x) = liminfn^oo^ o 

In order to prove the theorem, it is sufficient to show that ~g is inte- 
grable and; 

I K T)dP < f K gdP < j K idP (f) 

Then, as g < g, we must have equality in (f), so g = g a.e dP, that 
is og exists a.e dP, and; 

f K ogdP = f K gdP 

as required. 

Now let M G A/">o, then, as g is Q3-measurable, see [ 6 ], min(g,M) 
is integrable with respect to P. Let e > 0 be standard, then we can 
apply Theorem 12.11 in the Appendix to this paper, and Definition 3.9 
and Remarks 3.10 of [1], to obtain internal functions P, G : K —>■* P, 
with g < F and G < mining , M), such that; 

| f A ?nin(l 7 , M)dP — \*Yh x ^A ^( x )\ < f° r internal A C K, (ff). 

Now observe that ~g is </>-invariant,(Q). Fixing x G I\, by the defini¬ 
tion of g, we can find n G A /"> 0 such that; 

min(g(x), M) < ± ES diftx) + e (*) 

Then, if 0 < m < n — 1, we have; 

G(ft n x ) < min(g((j) m x) : M), by deffiiition of G 


1 There is a probably a proof of this result in the literature, but we supply one 
here. Fix x G K. Let A m = 9{ftft and let B m = A Ya=o g{ft +1 x). 

Then a simple calculation shows that mB ™+<A x > = A m+ \. Hence, | B m — A m+1 | = 

I ~ 4m+ m~ 9 ^^ I’ (*)• Suppose that g{x) = t < oo, (**), (the case when g(x) = oo is 
similar), and ’g(4>x) < t, (* * *), (the case ~g{(j>x) > t is again similar). Then, by 
(* * *), there exists 8 > 0, such that, for to > Too, B m <t — 6. By (*) and (**), we 
can find mi > too, such that | B m — A m+ i| < |, for to > toi. Again, by (*), we can 
find to. 2 > to i > too, such that A m2+ i > t — |. This clearly gives a contradiction. 
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= min(g(x), M ), by </> invariance of g 

<^Er=o^) + ^by (*) 

< ^ EEq 1 F(cj) l x ) + e, by definition of F 


Therefore, 

Er=o <W*) < n(i Er=o + <0 = EEo 1 ™ (**) 

Now let Sg ■ [1, k) x K — y *71 be defined by; 

S G {n,x) = ^EEo 1 G^x) 

and, similarly, define Sf- By Definition 2.19 of [3j, and using the 
facts that K is *-finite, and G, F are internal, Sq and Sp are internal. 
Then, the relation (**) becomes the internal relation on [1, k)xl \, given 
by R(n, x) iff Sg(ti, x) < Spin, x) + ne. Using the fact above, that the 
fibres of R over K are non-empty, by transfer of the corresponding 
standard result, we can find an internal function T : K —> [1, k), which 
assigns to x G K, the least n G [1, k), for which (**) holds. Moreover, 
as we have observed in (*), T(x) is standard, for all x 6 K. By Lemma 
3.11, r = max x& KT(x) exists and is standard. Now, define Tj hyper 
inductively by; 

T 0 = 0 and Tj = Tj_i + T(T J _ 1 ) 

and let J be the first j such that k — r < Tj < fc.(@) 

Observe that Tj dehnes an internal partition of the interval [0, Tj_i] C 
[0, k), into J — 1 blocks of step size Tj — = T((7}_i). Hence, we 

can write; 


2 This perhaps requires some explanation. Define / = {m € *A/">o : 

3\S(dom(S) = [0, m] AS(0) = 0A(V1 < j < m)S(j) = S(j - 1) +T(S(j - l) mod k))}, 
(=k), then it is easy to see that I is internal, 7(1) holds, and 7(m) implies I{m + 1). 
Applying Lemma 2.12 of [3], I = *A/ r >o. Hence there exists an internal function 
/, defined on *A/">o, such that f(m) is the unique S satisfying (*)• We can then 
define Tj = and clearly Tj — Tj -1 < r. Let V = {j £ *A/">o : Tj < kj. 

Then, as T > 1, V is the interval [1, t] for some infinite t < k. Then k — r < Tt <k, 
otherwise Tt+i < k. Then U = {j € *77>o : k — r < Tj < k} is internal and non 
empty. Therefore, by transfer, it contains a first element J. 
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i’ ZIP G(x) = i* E/i 1 * ES" G(^) 

< f E3? ,_1 WT,) + T(T)e ,by definition of T and («). 

Now we can rearrange this last sum as; 


I* Elio 1 EE + f Ei=o T (E) 

= rE^o 1 ^)+ z f 

< EEEo'EE + e 

using the facts that * E'/=o EE) = * E/=o (E+i “ E) = E/, and 
Tj < k. Therefore, we have that; 

I* EEo 1 EE < t Elio 1 EE + 6 (* * *) 

Now, observing that u([Tj,k)) < | ~ 0, as r is standard, we have 
P([Tj, k)) = 0. Hence, using (ft), (* * *); 

fx min(g, M)dP = J [0 Tj) min(g, M)dP < \*YExEo EE + e 

< I* Elio 1 F ( x ) + 2e < ./jo, tj) ddP + 3 e = f x gdP + 3e 

Now, letting M — * oo and e —* 0, we can apply the MCT, to obtain; 

J x gdP < f x gdP 

As g is integrable with respect to P, so is ~g, and a similar argument 
to the above demonstrates that f x gdP < f x gdP. Therefore, (f) is 
shown and the theorem is proved. 

□ 


We now generalise Theorem 11.31 to obtain Theorem 11.11 We let V 
consist of spaces of the form (PE D, A, a ), where D is the Borel field 
on PE a is the left shift on PE and A is a shift invariant probability 
measure. Note that a is not invertible, but we require that A = <r*A, 
so a is a m.p.t, with respect to A. Similarly, we let Q consist of spaces 
of the form ([0,1]E <£, p, cr), where <£ is the Borel field on [0,1]E a is 
again the left shift, and p is a shift invariant probability measure. 
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We first require the following simple lemma; 


Lemma 1.4. Theorem ] 1. 1\ is true iff the Ergodic Theorem holds for all 
spaces in V. 

Proof. One direction is obvious. For the other direction, let (0, (£, g, T) 
and g G L 1 (h2, £, g) be given. Define a map r : fl —* 7by r(u)(n) = 
g(T n u). Clearly, as g is measurable with respect to £ and T is a 
m.p.t, using the definition of the Borel field on 1Z' n , for finite m, we 
have that for a cylinder set U G 2), G £. By the definition 

of the Borel field on 7Z A \ r _1 (3D) C £, (p). Let A be the probability 
measure t*/j. Then A is a invariant, as clearly, using the fact that T 
is a m.p.t, A = cr*A on the cylinder sets in 3D. Using the definition of 
the Borel field and Caratheodory’s Theorem, we obtain that A = cr*A. 
Let 7r : VJ^ —> 7Z be the projection onto the 0 'th coordinate. Then 
q — 7tot, and, so n G L 1 (7?. A ^, 3D, A) by the change of variables formula, 
(Jj). Moreover, g(T l u ) = 7r(crV(u;)), so applying the Ergodic Theorem 
for (7Z/S, 3D, A, cr), with the change of variables formula, we have that 
og exists and og = ott o t a.e dg, and f^ogdg = f n (oTT o r)dg = 
OTrdX = f nA r nd\ = f n gdg as required. 

□ 


We make the following definition; 


Definition 1.5. We say that (fR/^,®, A , cr) G P is a factor of(K , IB, P, 0) 
if there exists; 

T : (K,<B,P) —>■ {n M ,®,\) 

which is measurable and measure preserving, such that; 

T{f>x) = cr(Ta;) a.e (iG A") dP. 

We make the same definition if ([0, l] 7 ^, (6, p, a) G Q. 


Lemma 1.6. Suppose that {fRf^ , 3D, A, cr) G P is a factor of(K, IB, P, 0), 
then, if the Ergodic Theorem holds for (K, *B, P, 0), if holds for (P A/ ”, 3D, A, cr). 

3 As {F € 2 D : r _ 1 (F) G £} is a cr-algebra containing the cylinder sets. 

4 This states that if r : (Xi, £i, pi) —>• (Xn £2, P2) is measurable and measure 
preserving, so p,2 = r*pi, then a function 6 G IA(X2j £2, P2) iff G JUfXi, £1, pi) 
and f c 6 dr^g 1 = f T -i, C ) r* 0 dy 
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Proof. The proof is similar to Lemma fl .41 If h G L l (IZ^, D, A), then, 
by change of variables, F*h G L 1 (/l, 55, P). Applying the Ergodic The¬ 
orem for (A', 03, P, <f>) and the definition of a factor, we have that o T*h 
exists and oT*h = T* o h, a.e dP, (*). So oh exists a.e dA, and, again, 
by change of variables, (*), and the Ergodic theorem for (K, 05, P, 0); 

j nM ohd\ = j K V*(oh)dP — f K o(T*h)dP = j K (V*h)dP = j nU hd\ 

□ 


We now claim the following; 


Lemma 1.7. Every space in V is isomorphic, in the sense of dynamical 
systems, ||) ; to a space in Q. 

Proof. There exists an isomorphism, in the sense of measure spaces, 
<f> : (P A: \ 23, A) —> ([0,1], O'), where <£' is the Borel field and p' is 
a probability measure, see [3], Theorem 1.4.4. Now define r : P 7 ^ —* 
[0,1]^ by r(uj)(n) = $(cr n uj). Again, using the argument above and the 
fact that $ and a are measurable, r _1 ((E) C 33, where is the Borel field 
on [0,1]-^. Let p be the probability measure r*A, so r : (PA,®, A) —>• 
([0,1]^, (B, p) is also measure preserving. We have that r(au)(n) = 
< f>(cx ri+1 u;) = (■ ru)(n + 1) = a(ru)(n), so r o a = a o r, for all co G P 7 ^. 
This also shows that p is a invariant, as A is a invariant. Hence, 
([0,1 } Af ,<£,p,a) belongs to Q. Define s : ([0,1]^, <£,p) —> (PA”,®, A), 
by, s(u/) = $ _1 (7r(u/)), where again 7r is the 0’th coordinate projection, 
clearly s is measurable. Then (sor)(w) = $ _1 o7ror(u;), and nor(u) = 
r(u>)( 0) = <f>(u;), so (s or) = Id a.e, and, similarly r o a = a o r a.e dA. 
This clearly shows that s is measure preserving, and that (r o s) = Id, 
s o a = a o s,(*), hold, restricted to r(U), where A (U) = 1. As, by 
definition, p(X(U)) = 1, and the conditions in (*) are measurable, we 
obtain the result. (Note that the map s need not be invertible in the 
ordinary sense.) □ 

We now make the following; 

Definition 1.8. Let ([0,1]^, £, p, a) belong to Q, then we say that a 
is typical for p if; 


J By which I mean there exists measurable and measure preserving maps r : 
(7 , ®, A) —t ([0, l] 7 ^, £, p) and s : ([0, l] 7 ^, <£, p) (AP, D, A) such that sor = Id 
and r o a = a o r a.e dA, r o s = Id and s o a = a o s a.e dp 
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lim n -t oo X^i=o a ) Jjoji]^ P^P 

for any g G C([0,1]^). 


We now show; 


Theorem 1.9. Let ([0, l] 6 7 8 ^, (£, p, a) belong to Q, possessing a typical 
element a. Then ([0, l] 7 ^, (£, p, a) is a factor of (A", 23, P, <f>) in the sense 
of Definition 11.51 

Proof. Define T : K —> [0, l] 7 ^ by r(x) = °(a x a), (0). Now suppose 
that g G C'([0, l]^), so, as [0,1]^ is compact, g is bounded,(*), then; 

°g(a x a ) = g(T(x)) for all x G K, (**) (0). 

This implies that T is measurable, as if B is an open set for the 
product topology on [0,1]^, then, taking g to be a continuous function 
with support B, T*g is measurable with respect to P, by Theorem 3.8 
(Lemma 3.15) of [3]. This clearly implies that T _1 (P) is measurable. 
By previous arguments, we obtain the result. Moreover; 

/[o,i] jV -)dp 

= lirrin-too - Zi=o 9 , ( cr * a ); (by definition of a typical element a) 

=°(TE‘:hK“)). 

= ° f K g(a x a)du (using Definition 3.9 of [1] and Remarks 3.10 of [1]) 


6 Here, ( a x a ) = *H{x) for the internal function *H : *J\f —> *([0,1]^) = 
(*[0,1])*^, obtained by transferring the standard function H : Af —> [0, l] 7 ^, de¬ 
fined by H(n) = cr n (a). Observe that [0, l] 7 ' 7 ' is compact and Haussdorff in the 
product topology, so, by Theorem 2.34 of [4|, there exists a unique standard part 
mapping ° : *([0, l] 7 ' 7 ) —> [0, l] 7 ' 7 . In fact, see [5], this mapping is defined by setting 
°s = (°s(n)) neA v where s : *Af —»* [0,1] is internal. 

'I have also denoted by g , the transfer of g to *D(*([0, l] 7 ^)). Observe that 
a x (a) ~ T(a;) by definition of T, it is then straightforward to adapt Theorem 2.25 
of [3], using the fact that g is continuous, to show that g(a x a) ~ g(T(x)). 

8 Observe that sin) = — YfiZ o 9i <jl ' a ) is a standard sequence, with limit s = 
/[ 0 ,i]-v gdp. By Theorem 2.22 of [3], using the fact that k is infinite, s — s(k). Using 

Definition 2.19 of [3], it is clear that s(k) is the hyperfinite sum k* X^=o 9( aXa ) 
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= f K g(r(x))dP, (using (*), (**) and Theorem 3.12 of [1] (Lemma 
3.15 of pf])) 

(* * *) 

The result of (* * *) implies that T is measure preserving. The prob¬ 
ability measure T*P defines a bounded linear functional on C([0, l]^), 
which agrees with p. Using the fact that [0,1]^ is a compact Hausdorff 
space, and p, T*P are regular, see 6] Theorem 2.18, (p), we can ap¬ 
ply the uniqueness part of the Riesz Representation Theorem, see [6j 
Theorem 6.19, to conclude that T*P = p, we will discuss this further 
below. Now, as a is continuous with respect to <£, 0.; 

cr(raf) = a(°(a x a) —° ( a(a x a )) =° ( a x+1 a ) = T(x + 1) = T(0(x)) 

except for x = k — 1, so a.e dP. Hence, the result follows. 

□ 

We now address the problem of finding a typical element for a space 
([0,1]"^, l£, p, a) G Q. By Theorem 1 1.31 Lemma 11.41 Lemma OH Lemma 
11.71 and Theorem 11.91 we then obtain the Ergodic Theorem 11.11 The 
proof of this result does not require the Ergodic Theorem, and is orig¬ 
inally due to de Ville, see [2J. 

Definition 1.10. We say that a sequence of measures (p n ) ng M con¬ 
verges weakly to p if, for all g G C([0, 1]-^); 

ii777 7l _»oo(Jjo ) i]A/' ydpri) J^^j^gdp. 

We require the following lemma; 

Lemma 1.11. Let (o n ) nG _yy be a sequence of periodic, with respect to 
a, elements in [0,1]^, such that the sequence of probability measures 
(Pa n )nejg converges weakly to p, where; 


9 It is easy to see that [0,1]^ is er-compact. This follows from the fact that finite 
intersections of cylinder sets form a basis for the topology on [0, 1] A ". Any open 
set in U in [0, l] m is a countable union of closed sets, as every x G U lies inside a 
closed box B with rational corners, such that B C U. Hence, any cylinder set is a 
countable union of such closed sets n~f(B). 

10 Again I have denoted by a the transfer of the standard shift er to *([0,1]^)- 
The fact that a(a x a) = a x+1 {a) follows immediately by transferring the standard 
fact that cr(cr"(a)) = <r ra+1 (a) for n G M. 
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Pan — + • • • + S a cn -I a „) 

5 an denotes the probability measure supported on a n and c n denotes 
the period of a n . Then there exists a sequence (r n ) neA/ - of positive inte¬ 
gers, such that if(T n ) neJ y is defined byT 0 = 0 and T n+ i—T n = c n r n , the 
element a E [0,l] 7 / defined by a(m) = a n (m—T n ), forT n < m < T n+ 1 , 
is typical for p. 

Proof. The proof is intuitively clear, but hard to write down rigorously. 
As p an converges weakly to p, we have that; 

Hm n ->oo(fx f d Pa n ) Jx f dp 

By definition of 

fx fdPan = ^(/(«n) + • • • + f(<T Cn ~ 1 a n ) 

So it is sufficient to prove that; 

lim n ^Y17 =o f( a * a ) = ^iR n ^ 00 A(/( Q!n ) + • • • + /(o- c " _1 a n )) (*) 

We first claim that, if / E CQO, l] 7 ^), there exists an increasing se¬ 
quence {m n } ne jg °f positive integers, such that if b, c E [0, l] 7 / and 
agree up to the m n ’th coordinate, then | f(b) — /(c)| < (**). In 

order to see this, for x E [0,1]^, let U x = {y : \f(x) - f(y)\ < 

As / is continuous, U x is open in the Borel held, hence there exists 
14 C U x , containing x, of the form 7 t _1 (B4), where W x C lZ nx is 
open, and 7r is the projection onto the first n x coordinates. Then, if 
y,ze U x , | f(y) - f(z) | < |/(2/) - f(x) \ + | f(z) - f(x)\ < The sets 
{V x : x E X} form an open cover of [0, l] 7 / which is compact in the 
product topology. Hence, there exists a finite subcover V Xl U ... U I4 r . 
We can choose m n such that each V Xj is of the form 7r -1 (W4.), for 
W x . C 7Z mn . Then, if b and c agree up to the m n 'th coordinate, we 
have that b E V Xj iff c E V Xj , so | f{b) — /(c)| < showing (**). Now 
let {9n}n 67 V be any increasing sequence of positive integers, such that if 
Q n = sup{\f(b ) - /(c)I : 7 Tgjb) = 7T 9n (c)}, then {Q n }neM is decreasing 
and limn^ooQn = 0. Clearly such a sequence exists by (**). Without 
loss of generality, we can choose {g n }neAf, such that the periods c n \g n , 
(jf). Now choose {Ti} ie jg- as follows; 

(*)■ /+1 4 2 l Ti 
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(ii). gi\T i+ i - Ti (so Ci\T i+1 - T, t ) 

(in). Ci = > Q _i = (i > 1). 

(iv). Ti > 2*Cj (i > 1). 

We now claim there exists a decreasing sequence {b n } ne j^ >0 of posi¬ 
tive reals, such that; 

1^7 ESo" 1 f( aia ) ~ tn\ < K (* * *) 

where /?m, woo 6 n = 0, and t n = T.( f(a n ) + ... + /(cr c " _1 a n ), for 
n > 1. For ease of notation, we let; 

A n = i Er=o /(<**) 

An,n = ^ EEm /(^«) 

Recall the law of weighted averages, . We hrst 

estimate \A Tn - Ar n _ liT J. We have; 

A _ T »-l A T„_ 1 +(Tn-Tn-l)A Tri _ liTl[ 

^ “ - T n - 

\A Tn - A Tn _ u T n \ 

I T n -i a i T n —T n -1 /i 4 I 

- !—H- jr A Tn _ u T n ~ 

< ^ by (i) 

< where |/| < M, (A) 

We now estimate the average Ax n _ li T n - The idea is to divide the inter¬ 
val between T n _i and T n into C ' n _1 blocks of length g n -i, where the pe¬ 
riod c n _i|<? n _i, using (jf) and (ii). We estimate \A Tn _ uTn - A Tn _ 1)Tn _ gn \; 

A T n -l,T n — Cn-1 AT n-l.Tn~gn^l T C n -1 AT n~9n-l,Tn 

\ A T n -i,T n ^-T n _i,T n — g n _i I 

_ I y ^T n -g n _ 1 ,T n _ ^ T n_ 1 ,r„-g„_ 1 i ^ 2 M f 

Cn — 1 Cn — 1 C n — 1 ' ' 
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We now let; 


B 


Tn—i,m 


— 1 V-m- 

m—T n -1 2^ii= 


m—Tn -i — l 


f(cr l a n -i), for m < n. 


We estimate |Ar n _i )Tn _ 9n _i-i? Tn _i )Tn _ 9 J. We have that a Tn - 1+l a and 
o l a n -\ agree up to the g n _i’th coordinate, for 0 < i < T n — T n _i — g n -\. 
Therefore, for such i, \f(a l a n -i) — f(cr Tn - 1+l a)\ < Q n -i, and so; 


I ^-Tn—i,T n —g n —i B Tn _ uTn _ 1 -g n _ 1 \ < Qn -1 (C) 

Now, by the same argument as in (B); 

I B Tn _ lt T n - B Tri l Tn _ gn \ < (D) 

Finally, by periodicity; 


BTn-uTn = ^(/(ttn-i) + • • • + /(^ Cn “ 1 1 (*n- 1)) = 4. ( E ) 

Now, combining the estimates (A), (B), (C), ( D ), (E), we have; 

I A _ + I <r M , 2M I n I 2M _ /, 

|^*-T n | _ 2 n—2 ' 2 n—2 ' 1 ' C n -i 

Clearly {h n } ne AT is decreasing. Moreover, /im n _ i . 0O 6 n = 0, as /im n _ ) . 00 C' n 
oo, (m), and by the choice of { Q n }neM ■ This shows (***). We now 
have to estimate the averages up to place between the critical points 
T n and T n _\. 


Case 1. The place v is a periodic point of the form; 


T n + mg n , where 0 < m < C n — 1 

We have A v = XA Tn + (l-X)A Tn V (0 < A < 1), where \A TnjV —t n+1 \ < 
Q n , by (C), (E), and | A Tn -t n \ < b n , by (***). Now, let t = lim n ^oot n . 
Given e > 0, choose N(e), such that \t n —t\ < e, for all n > N(e). Then; 

|Ay - t\ < max{\A Tn - t\,\A Tn>v - t|} 

< max{b n + f,<3n + f} 
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Choose iVi(e) > N(e), such that max{b n , Q n } < for all n > Ni(e), 
then \A V — 1\ < e, for all n > N\ (e). 

Case 2. The place v is a possibly non-periodic point of the form; 

T n + w, where 0 < w < T n+1 - T n _ 1 - g n . 


Choose periodic points Vi and V 2 , with T n < v 1 < v < i >2 < T n+ i—g n , 
and v 2 -v 1 = c n , so 0 < v-vi = e < c n . Then A v = 

As Vi > T n , we have; 


< < < _L Uy 

— T„4-p — T„ — 2™ •> 


Vl+e — T n +e 




Therefore; 


I A, — A Vl \ — |(1 — 5)A Vl + hAiy — A Vl \, (5 < A-) 

< h(|A>i| + |Ai,t;|) — 2 ^=t 

For n > 1Vi(§), \A Vl —t\ < by Case 1, so \A V —£| < e, for n > N 2 (e), 
where N 2 (e) = max{Ni(^), log{^-) + 2}. 

Case 3. The place v is of the form; 

T n + w, where T n+1 - T n - g n < w < T n+1 - T n . 

We have; 

A v = A A Tn + (1 - \)A Tn ^ v , (0 < A < 1), (f), 

A Tn ,T n+1 = ^A Tn , v + (1 - /z)A,T n _HU - V - 1 
Therefore; 

\A Tn ,T n+ i ~ A TnjV | < ^ 

I A r [' n gi' n j rl Ci+l| ^ 6 n _|_l, by (B), (C), (D), (E) 

|Ar„,i; — t n + 1| < + b n+ 1 
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\A Tn - t n | < b n by (* * *) 

|A, ~t\< max{\A Tn - t\, | A Tn>v - t\} by (f) 

< max{b n + | t n -t\,^ + b n+1 + | t n+x - t|}, (ft) 

We have, for n > iV(|), max{| t n — t\,\t n+ i — £|} < |. Choose 
N 3 (e), such that max{b n , + b n+ \ } < |, for all n > jV 3 (e). Then, for 

n > N 3 (e), |A -t\<e. 

To complete the proof, let i\T 4 (e) = max{iVi(e), N 2 (e), N 3 (e)}. Then, 
for n > i\r 4 (e), |An —1| <6, for all m > T n , by Cases 1,2 and 3. There¬ 
fore; 

Unim^-oaA /Va) = ,/ x 
so a is typical, as required. 

□ 


We now formulate the following criteria. 


Lemma 1.12. Suppose that for every g £ C'([0,1] A/ "), and e > 0, there 
exists a periodic element /? £ [0,1]E with; 

I ./[04 A ddp/3 Jjoqjw 9^p\ e 

then there exists a sequence of periodic elements (a n ) neAf , with (p Qn ) n e M 
converging weakly to p. 

Proof. We abbreviate [0,1to X. Let Xi denote the vector space of 
real valued regular measures on (. X , <£). As we observed every proba¬ 
bility measure belongs to XI. Xt is a Banach space, with norm defined 
by total variation, see |6]J. Using the Riesz Representation Theorem, 

M can be identified with the dual space C(X)*. It is easy to see that 
then M = C(X)*, as Banach spaces, however, we will not require this 
fact. The weak ^-topology, see [I], on XI, is the coursest topology for 
which all the elements g £ C(X)**, where g £ C(X), are continuous. 
Formally, we define a set U C XI to be open if for all p £ U, there 
exist {g\ ,. .., g n } C C(X), and positive reals {ei,..., e n } such that; 


{p' £ M : | p'(gi) - p(gi)\ < e*} c U 
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Fixing p, let U p denote the open sets containing p. We show that U p 
has a countable base, (*). Using the compactness argument, given in 
Lemma 11.111 and the Stone-Weierstrass Theorem, see [T], it is easy 
to show that the space V of pullbacks of polynomial functions on 
[0, l] n , for some n, is dense in C(X). Clearly V has a countable ba¬ 
sis, which shows that C(X) is separable, that is, contains a count¬ 
able dense subset Y. Now suppose that g G C(X), e > 0. Let 

U gf = {pf : \p'(g) — p{g) | < e}, and D G Q. Choose 5 G Q with 

5 < i ( d + 2 \ p ( x )\) > an( i 7 G <2 with 7 < |. Choose h G Y with 
\\g-h\\ C (x) < 5- Then U htl CUi )D C U g>e , (**), as if \p'{h) - p{h)\ < 7, 
then; 

I p'(g) - p(g )I = I p\g -h)+ p'{h) - p{g - h) - p(h)\ < S(\p'(X)\ + 

IpWI)+7 

and, if |p'(l) - p(l)| < D, then \p'(X)\ + |p(X)| < D + 2|p(X)|, 
so | p'(g) — p(p)| < e. This clearly shows (**). As sets of the form 

Uh, q G Up, for h G Y, and q G Q, are countable, we clearly have (*). 

Let / : —> Up be an enumeration of the sets Uh, q , and let J : Af —» U p 
define the intersection of the first n elements in /. If the assumption in 
the lemma is satisfied, we can define a sequence of probability measures 
(Pan)neAG by taking p an to lie inside the open set J(n). Then clearly 
such a sequence converges to p in the weak ^-topology, hence, for any 
g G C(X), as g is continuous for this topology lim n ^. 00 p an (g) = p(g). 
Therefore, the sequence (p Q „)neM converges weakly to p. □ 


We refine this criteria further; 


Definition 1.13. Given a positive integer m, we define the partition 
E m of [0,1] to consist of the sets; 

Ej m = [T, —) for j an integer between 0 and m — 2 

p _ r m —1 11 

J-'m— l,m [ m ! rj 

Given positive integers m,n, we define the partition B m)n of [0, l] n 
to consist of the sets; 

Ej ) m,n Ej 0tm X Ej i m X ... X Ej n i m 
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where j = (jo, ji, ■ ■ ■ ,jn- 1 ) and {jo, • • ■, j n -i} are integers between 0 
and m — 1 . 

We define the partition C m ^ n of [0,1]^ to consist of the sets; 

C'j,m,n ^n (-®j ,m,n) 

where 7T n is the projection onto the first n coordinates. 

Lemma 1.14. Let e > 0, g G C(X) be given as in Lemma \1.1 C A and 
let p’ be a regular Borel measure, then there exist positive integers m, n, 
and 5 > 0 , such that, if; 

I P ( ^j,m,n ,) P{Cj,m,n) I ^ d 

for all sets C- ] m n belonging to C m _ n , then; 

I /[o.i]^ 9dp ~ /[o,i]ai gdp\ < e 

Proof. For a positive integer n. let W n consist of the inverse images in A" 
(from the projection n n ) of open boxes in [ 0 , l] n , with rational corners. 
Let W = UneJV^ra- ^ c l ear that W forms a countable basis for the 
topology on [0,1] . Adapting the compactness argument, given above 
in Lemma [1.Ill for any 7 > 0 and g G C(X), we can find a positive 
integer n, and finitely many sets {I4j )n , . .., W r>n ) in W n , covering X, 
such that | g(x) — g(y)\ < 7 for all x,y in Wj_ n , 1 < j < r. Now choose 
m such that each set of the partition C m , n lies inside one of the 14j 
Then | g{x) — g(y)\ < 7 on each Cj mn , belonging to C m>n . Now, for 
given 5 > 0 , suppose we choose p' such that |p , (C'j mn ) — p(Cj jTnjn )\ < S, 
(*). Then; 

I Jx 9dp’ - f x gdp\ = | fc. 9dp' - Ej fc 9dp\ 

< Y,~j I Jc- 9dp' - j c . gdp\, (**) 

J j ,m,n j ,m,n 

Without loss of generality, assuming p' is positive, by definition of 
the integral, see [6], we have that; 

CjP (Cj m n ) A JL gdp A djP (Cj m n) 

Cjp(Cj m^n) — Jcj m n 9 dp ^ djp ( Cj ) 
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where m = inf a-. Q and d i = supc . g. Then; 

Cjp (Cj m,n) djP^Cj m,n) — Sc- 9 d p 5c- 9 d P 

— djP (Cj^rn, n ) Cjp{Cjjmjri) 

Therefore, again, without loss of generality; 

I 5c- d d P' ~ 5c, 9 d p\ 

— ( d j pj )P (^7 'j,m,n ) T |Cj||p (Cj',m,n) P(^ 7 /,m,n)l ^ dP if-^j,m,n) T |Cj|$ 

(* * *) 

BY (*), P'OO = EiP / ( C 'j,m,n) < EjPtCj.m.n) + <5m n = 1 + 5m n , SO 

using (**), (* * *), and the fact that \g\ < M; 

| f x gdp' — f x gdp\ < 7(1 + din 71 ) + 5Mm n 

So if we choose 0 < 7 < | and 0 < S < 2 p r +M) m n ’ we obtain; 

I fx 9 d p' ~ fx 9 d P\ < e 
as required. 

□ 

We finally claim; 


Theorem 1.15. If C' m , n is a partition, as in Definition \777M and 6 > 0, 
then there exists a periodic element (3, such that; 

I Pp{f- d j,m,n) P^f- d j,m,n)\ ^ d 

for all sets Cj mn belonging to C rn , n . 

Proof. Let £ = {^, ..., }. Dehne k : T n -A- TZ by; 


«(( 


2jo+l 
2m > 


2jn — 1 H~1 
2m 


)) = P(Cj,m,n) 


As C’m.n is a partition of X and p is a probability measure, a is a 
probability measure on TP. Moreover, using the partition property and 
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the fact that p is a- invariant; 

X/£ 0 gE K ((£o) • • • ) £n— l)) — P(^n ([0) 1] * ^ji,m X ... X Ej nim )) 

— p{^n X ... x Ej n _ i m X [0, 1])) 

= S^ 0 gE K ((£l> • • • i £n-l> 6)) (*) 

Now let iV > 0 be a sufficiently large positive integer, then we claim 
that we can find a probability measure n' on E n such that; 

(f). |k'( 0 - j«(01 < 5 

(ii). The condition (*) still holds. 

(in). iW(£) is a non-negative integer, for all £ € E n 

This follows from a simple linear algebra argument. We can identify 
the set of real measures on E n with the real vector space V of dimension 
m n . The condition (*) then defines a subspace W C V. The condition 
of being a probability measure requires that; 

K ((£l) • • • 5 £n-lj 6)) = 1) (**) 

which defines an affine space S a ff C V. S a ff H W contains a ratio¬ 
nal point q, corresponding to the probability measure with coordinates 
m~ n . It is straightforward to see that (S a ffP\W) = [(S a ff — q)P\W]+q. 
Moreover, (S a ff — q) fl W is a vector space defined by rational coeffi¬ 
cients, so it has a rational basis. This shows that rational points are 
dense in S a ff D W. We can, without loss of generality, assume that 
all the coordinates of k are strictly greater than zero. If not, consider 
instead the space S a ff fl W fl W', where W' = Ker(n) is the kernel 
of the projection onto the non-zero coordinates of k. The same argu¬ 
ment shows that rational points are dense in S a ff fl W fl W’. We can 
now obtain a probability measure k', satisfying conditions (i) — (in), 
by finding a rational vector sufficiently close to k in S a ff fl W, and 
choosing N large enough. 

Now take a longest sequence {£°,..., £ r_1 } of elements in E", such 
that; 
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(1) . (£,...,a_i) = (^ + V--,a- 2 )- 

(2) . Card({i : 0 < i < r, £* = £}) < iW(£) for any £ G S n 
where C = (fj,..., C_ x ), for 0 < i < r, and = £°. 
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Then, by graph theoretical considerations, (0), one can show that 
equality holds in the above inequality in (2), for any £ £ £ n , (***). 

n The graph theory argument proceeds as follows. We construct a tree. For 
every £' € E ra_1 , where £' = (£i,..., £„_i), associate a vertex (the trunk). 
Similarly, for every £ G E n , where xi = (£o, ■ • ■, £ n -i), associate two vertices l f 
(left) and rj (right). Attach the vertex l £ to v? iff 7t(£) = £', where n is the 
projection onto the last n — 1 coordinates, and, attach 1 1 to . iff 7 t'(£) = £', 
where n' is the projection onto the first n — 1 coordinates. In this way, we obtain a 
tree, having m n ~ 1 (2m+ 1) vertices, m n ~ 1 (2m) branches, and m n -i components. 
Each element £ G E™ corresponds to two vertices, one on the left and one on the 
right of the tree. Now attach weights to the left vertices and right vertices 

respectively, by assigning the vertices and r^, the weights = Nk'(£) and 
n £ = iW(£) respectively. Observe that, by the condition (*) in the main text, for 
any given £'; 

m i' = (£)=£' = n t' = X^eE":7r'($)=£' n £ (t) 

Now, given a sequence {£°, £ 1 ,..., £ fe } of elements in E ra , where £ z = 
(£o, • ■ ■, Ci-ib for 0 < i < k, we attach sets L^ to each vertex l^, by requiring 
that, £* G L^ iff £® = £, and, similarly, we attach sets R% to each vertex r%. We call 
a sequence allowed if (i). For each £ G E”, Card(L^) = Card(R^) < and 

(ii). For each 1 < i < k, if £ l appears in the set R £, then £* _1 appears in a set Lj", 
where and rj are attached to the same vertex vp, so that 7 t(£") = 7t'(£) = £'. 
Clearly, all allowed sequences are bounded in length by Nk'(X), so there exists a 
longest allowed sequence s = (£*)o <i<t- Let £* be the final element in the sequence, 
and suppose that £* G L^r, then, we claim that £° belongs to a set where 
7 t(£") = 7r'(£) = £', (ff). If not, all such sets R^, with 7r'(£) = 7r(£"), consists of ele¬ 
ments £* with i > 1. If, for one of these sets R^, Card(R^) < n^, then we can extend 
the sequence by setting £ t+1 = £, clearly such a sequence is allowed, contradicting 
maximality. So we can assume that Card(R^) = n j. By condition (ii), for every 
element £®, i > 1, appearing in R £, there exists an element £ l_1 appearing in an 
Lj//, with 7 t(£") = 7r(£ 4 ). This provides a total of w + 1 elements appearing in such 
L?>, where w = ‘ By (t)> this is greater than EfeE»:ir(0=£' m £- 

Clearly, this contradicts condition (i) of an allowed path. Hence, (ff) is shown. 
Observe also that if £' G E n_1 , and s r ^> denotes the total number of elements from 
the sequence s, appearing in sets to the right of £', si^>, to the left, then si^> = s r ^>, 
In particular, by (f), m^ — Si^ = n^ — s r ^ > 0, so the number of ’’vacant slots” 
(if there are any), is the same on both sides of a given £', (fft). In order to see 
this, we can, without loss of generality, assume that 7r'(£ 0 ) ^ £', then just note that 
an element £ l+1 belongs to a set on the right of £' iff £* belongs to a set on the 
left of £', by condition (ii) of an allowed path. We now claim that for all £ G E", 
Card(R^) = n^, (fftf), (so there are no vacant slots). We have already shown this 
in the particular case when 7 t'(£) = 7r'(£°). We define an element £ to be cyclic if 
tt(£) = ti-'(£), so cyclic elements are just constant sequences. We define an element £ 
to be free if Card(R^) < n^. No free cyclic element £ C2/C can encounter the sequence 
s, for suppose that there exists a £®, for some 0 < i < t, with 7r(£®) = n'(£ cyc ), 
then we can extend the sequence s to s' = {£°, ...,£*, £ cyc , £ l+1 ,..., £ 4 }, and still 
obtain an allowed path, contradicting maximality. So we have that, if £ is free 
cyclic, with 7r^ = £', then si^> = s r ^ = 0, (ttttt)- Now suppose there exists a 
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Now let f3 be the periodic element in [0,1]^, with period n + r — 1, 
defined by; 

(m,m, ...,p(n+ r - 2 )) = (c &..., ^_i, e n -i, e n -i ,..., 

By (i), it is sufficient to prove that, for each j e m n ; 

|P/9( C 'j,m,n) - «'(£j)| < <£ (* * **), 

where e = minj(8 — |k'(£j) — /c(£j)|), and is the unique element of 
E n lying inside C- j>m>n . By definition of p p , pp(C- jjmjn ) = ■^ rT , where; 

cj = Card({k : 0 < k < n — r — 1, ir n (a k (/3)) = £j}). 

By definition of /3, and (***), cj = where 0 < y < n. As 

k' is a probability measure, again by (***), we have that r — 1 = N. 
Hence; 

c j _ NK '(tj)+v _ // c _\ , 

n+r—l ~ N+n ~ K + A+n ’ 

Therefore, 

|P/8( C J,m,n) - < IvTil < e - 


free element £/ ree - Choose the largest k, with 0 < k < t, such that £ fc appears 
in L^, with 7 r(£") = 7 r'(£/ ree ), (tt)- As we have observed, k < t. We construct 
a forward path from £f ree as follows. Define rj° = £f ree , add the element 77 ° to 
Re free and Lc free , and call the new sets i?o,f and L 0 ,j, for £ £ E™. Having defined 
, there are four cases. If = tt'( 77 °), terminate the sequence. Otherwise, if 
7r(? 7 J ) = 7 r(^ C y C ) for some cyclic element with Card{Rjc c ) < nc c , then define 
77 J+1 = add the element 77 J+1 to Rj,^ cyc and , calling the new sets Rj+i,£ 
and Lj+i t £, for £ £ E". If there is no such cyclic element, and there exists a free 
element £' with = 7 r'(£') and Card(Rj^) < n {/, then define 77 J+1 = £' (so 

there is some choice here), and, as before, redefine the sets Rj^ and Lj to Rj+i,^ 
and Lj + \£, for £ £ E”. If there is no free element of this form, then terminate the 
sequence. It is straightforward to see, using (fff), (ffttf), and the fact that 77 0 is 
not cyclic, that the sequence { 77 0 ,..., rf} terminates after a finite number of steps 
l, with l > 0, and n(ri l ) = tt ’(if). Moreover, for all k < i < t, and 0 < j < l, 
we have that 7 r(£*) ^ Tr'{rf), by (jj). Hence, we can construct an allowed sequence 
s" = {£°,..., £ fc , 77 0 ,..., 7/e +1 , • • •, £*}, contradicting maximality of s. This shows 
(ftft). It is clear that the sequence s'" = {£°, ..., £ r_1 }, as defined in the main 
text, is a longest allowed sequence, as defined in this footnote, using (ff). Hence, 
by (tftt), we have equality in ( 2 ) as required. 
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if we choose N sufficiently large, 
are shown. 


Hence, (* * **) and the theorem 

□ 


We summarise what we have done; 


Theorem 1.16. The Ergodic Theorem [777] holds and admits a non¬ 
standard proof. 

Proof. Combine Theorems II.3111.9111.151 and Lemmas ll. 4111.6111. 7111. 11 111. 12111.141 

□ 

Remarks 1.17. There are some outstanding questions in Ergodic The¬ 
ory, which one might hope to solve using nonstandard methods, similar 
to the above. One of these is Ornstein’s Isomorphism Theorem, I hope 
to investigate this direction further. 

2. Appendix 

Theorem 2.1. Suppose g : X —>■ IZ is integrable with respect to pi, 

Pl(X) < oo, and e > 0 is standard, then there exist F,G : X —>•* IZ, 
which are 21- measurable, such that; 

(i) . G < g < F. 

(ii) . | f A gdp L - f A Gdv\ < e, | f A gdp L - f A Fdv\ < e 
for all A e 21. 

Proof. Consider, first, the case when g > 0. 

Upper Bound. As g is integrable, by Theorem 3.31 of [4j, it has an 
integrable lifting F', such that °F' = g a.e pl, and; 

° lx F ' dv = fx 9dp L 

Without loss of generality, we cam assume that F' > 0. Now let 
e > 0 be given and choose 5 > 0 such that pl(X)5 < |. Then F' + 5 
is S'-integrable and F' + 5 > f a.e pl, (*), F' + 5 > 0. Moreover; 


f x (F' + 8)dv = f x gdp L + 8p L (X ) < C + f, (**) 
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where C = J x gdnL■ Let N G VJIl, with ^l(N) = 0, such that (*) 
holds on N c . Let N n = N D g _1 ((n — l,n]), for n G JV >0 , N 0 = 
N fl 5 ,_ 1 ( 0 ). Then N = [J n> 0 N n , and gL{N n ) = 0. By Lemma 
3.15 (3.4(i)) of [gj, we can choose U n D N n , with U n G 21, such that 
HL(U n ) < Mn ( +l y, ■ Inductively, define F 0 = F' + S, and, having defined 
F n . let F n +1 F n on U° +1 , and F n+ i = F n + n +1 on U n+ i. Then {F n } 
is an increasing sequence of 2l-measurable functions. Moreover; 

fx F n+idv 

= J [7 e +1 F n dv + f Un+1 (F n + (n + 1 ))du 

~ f x F n dv + (n + l)/j, L (U n+ i) 

< fx F ndv + 4 ( n+1) 2 

fx F ndv < c + | + £m= 1 4^2 < C + 6 (using (**)) 

We clearly have that for all x G N n , g(x) < F n . Now, by countable 
comprehension, we can find an internal sequence {F n } ne *xf extending 
the sequence {F n } n£ jg-. By overflow, there exists an inhnite u, such 
that F n < F u , for all n G A/", F u > 0, and; 

f x F u dv < C + e, (f) 

Clearly g(x) < F u (x), for all x G X. Now, if A G 21, with; 


f A F u dv - f A gdg L > e 


then, using Theorem 3.16 of [g|; 

fx F udv 

= f A F u du + f Ae F u du 
> e + f A 9dHL + f A c gd^L = C+ e 

contradicting (f). Setting F = F u gives an upper bound. 
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Lower Bound. Again choose 5 > 0, with hl(X)S < |. Let F' be as 
before, then F' — 5 is S'-integrable, F' — 5 < g a.e Hl, and: 

J X (F' ~ b)dv >C-I 

Again choose N, with (Il(N) = 0, such that F' — 5 < g on N c . Using 
Lemma 3.15(3.4(i)) of [4] again, we can choose a decreasing sequence 
of sets {U n } neAf>0J belonging to 21, with U n D N, and n L (U n ) < ±. By 
S'-integrability; 

° JhJF'- S)dv = f Un °(F'- S)dvL 

and; 

lim n -xx>(f Un °(F' - 6)dfi L ) = 0 

by the DOT, as °(F' — 5)xu n converges to 0 a.e /i/\. ffence, for suf¬ 
ficiently large n, we can assume that; 

SvSF’ - 8)dv < | 

Now let G = (F' — 5) on U%, and G = 0 on U n . Clearly G(x) < g(x), 
for all x E X. Moreover; 

Sx Gdv 

= f v .(F'-S)di, 

= f x (F' - d)dv - f Un (F' - 5)dv >C-e 

The same argument as above shows that, for all A £ 21; 

Ja 9 d ^L - f A Gdv < e 

Hence, G is a lower bound. 

Now, if g is integrable (jll, we can write g = g + — g~, with {g + ,g~} 
integrable hl. Choosing G > g + and H < g~, G — H > ( g + — g~ ) = g, 
choosing G' < g + and H' > g~, G' — H' < ( g + — g~ ) = g , and, clearly, 
we can obtain the integral condition, using |. 


□ 
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